Adaptation of acoustic models for multilingual recognition
نویسندگان
چکیده
This paper evaluates the recognition performance of a system using acoustic models transformed across language boundaries. Parameters of hidden Markov models (HMMs) trained on speaker independent English data are adapted using Afrikaans adaptation data to realise speaker dependent, multispeaker and speaker independent Afrikaans models. Adaptation is performed using maximum a posteriori probability (MAP) and maximum likelihood linear regression (MLLR) methods on context independent and context dependent phones. Results show that MLLR transformation of English models using Afrikaans adaptation data signi cantly improves model performance and for context dependent models achieves better performance on speaker independent tests than achievable by direct training on the adaptation data.
منابع مشابه
Pronunciation and Acoustic Model Adaptation for Improving Multilingual Speech Recognition
In this paper, we address the importance of pronunciation and acoustic model adaptation in multilingual speech recognition. When aiming at modeling several languages simultaneously, the degree of speaker and language variability is even greater than when concentrating on only one language. To compensate the pronunciation variability across various speaker, bi-lingual pronunciation modeling is p...
متن کاملRecent Progress in the Decodin with Multilingual Aco
In this paper we report on recent progress in the use of multilingual Hidden Markov Models for the recognition of non-native speech. While we have previously discussed the use of bilingual acoustic models and recognizer combination methods, we now seek to avoid the increased computational load imposed by methods such as ROVER by focusing on acoustic models that share training data from 5 langua...
متن کاملMultilingual Pronunciat Improving Multilingual S
Multilinguality aspects are becoming increasingly important in the Automatic Speech Recognition (ASR) systems. It is apparent that coping with large variability of the speech signal is an even bigger challenge in multilingual ASR systems than it has been in conventional monolingual systems. In this paper, we address the importance of combining multilingual pronunciation modeling and acoustic mo...
متن کامل2016 BUT Babel System: Multilingual BLSTM Acoustic Model with i-Vector Based Adaptation
The paper provides an analysis of BUT automatic speech recognition systems (ASR) built for the 2016 IARPA Babel evaluation. The IARPA Babel program concentrates on building ASR system for many low resource languages, where only a limited amount of transcribed speech is available for each language. In such scenario, we found essential to train the ASR systems in a multilingual fashion. In this w...
متن کاملOnline Unsupervised Multilingual Acoustic Model Adaptation for Nonnative Asr
Automatic speech recognition (ASR) is currently one of the main research interests in computer science. Hence, many ASR systems are available in the market. Yet, the performance of speech and language recognition systems is poor on nonnative speech. The challenge for nonnative speech recognition is to maximize the accuracy of a speech recognition system when only a small amount of nonnative dat...
متن کاملEvaluation of several Maximum Likelihood Linear Regression Variants for Language Adaptation
Multilingual Automatic Speech Recognition (ASR) systems are of great interest in multilingual environments. We studied the case of the Comunitat Valenciana where the two official languages are Spanish and Valencian. These two languages share most of their phonemes, and their syntax and vocabulary are also quite similar since they have influenced each other for many years. We constructed a syste...
متن کامل